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Abstract 

We consider an n-tuple of independent ergodic Markov processes, each 
of which converges (in the sense of separation distance) at an exponen- 
tial rate, and obtain a necessary and sufficient condition for the n-tuple to 
exhibit a separation cutoff. We also provide general bounds on the (asym- 
metric) window size of the cutoff, and indicate links to classical extreme 
value theory. 

1 Introduction 

It is well known that a large number of Markov chains exhibit cutoff phenomena 
when converging to stationarity. This phenomenon occurs when the distance 
of the chain from equilibrium (measured using, for example, the total-variation 
metric or separation distance) stays close to its maximum value for some time, 
before dropping relatively fast and tending quickly to zero. Such behaviour was 
first identified for the transposition shuffle on the symmetric group [5], and has 
since been shown to hold for many natural sequences of random walks on groups 
(see [14] for a review). 

In a recent paper [2], Barrera et al. consider ?i-tuples of independent pro- 
cesses, and give sufficient conditions for cutoffs to hold when distance from 
stationarity is measured using total-variation, Hellinger, chi-square and Kull- 
back distances, under the assumption that each coordinate process converges 
exponentially fast. In the particular case when all coordinates converge at the 
same rate, the window size of the cutoff (to be defined below) is also determined. 

In this paper we consider the separation distance of such n-tuples from sta- 
tionarity and give conditions (very similar to those in [2]) guaranteeing the 
existence of a separation cutoff. Our approach is slightly different from that of 
Barrera et at, however: instead of working with a set of ordered exponential 
rates we choose to work with discrete probability measures. This enables us 
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to relate cutoff to convergence of (suitably scaled versions of) these measures. 
Furthermore, we are able to provide general bounds on the window size of the 
cutoff (not only when all coordinates converge at the same rate). In particular, 
we show that in general the right-hand side of the cutoff window may be of 
significantly larger order than the left. 

The paper is organised as follows. In Section [5] we recall the definitions of 
total-variation and separation distance, and make formal the notion of cutoff 
time and window size. In Section [3] we present our main result concerning the 
existence of a separation cutoff, and prove general bounds on the window-size of 
such a cutoff. We then apply this to the example of a continuous-time random 
walk on the hypercube ZJ, where each coordinate may move at a different rate, 
and present a specific case which shows that our general window-size bounds are 
tight. Some links to classical extreme value theory are also highlighted. Finally, 
in Section 2J we briefly consider the notion of a coupling cutoff for two such 
n-tuples. 

2 The cutoff phenomenon 

In keeping with the notation of [5], for two probability measures /i and u on a 
finite space (E, £) we shall write D(/i, v) for a general notion of distance between 
them. One example is total-variation distance 

D{^,v) = - HItv = SU P \v( A ) - v{ A )\ i 
while the separation distance is defined to be 

D{n, v) = sep (u, v) = max < 1 — > . 

xeE [ i/[x) J 

Note that separation is not a metric due to its asymmetry. Both of these 
distances take values in [0, 1], and it is simple to show [T] that 

- z/|| TV < sep(//,z/) . 

Separation distance is intimately linked with the notion of strong stationary 
times. Let X be a Markov chain with time-i distribution P* and stationary 
distribution it. 

Definition 2.1. A strong stationary time (SST) T is a randomized stopping 
time for X such that 

F(X t = k | T < t) = ir(k) , for all < t < oo, k G E. 

If T is a SST for X, then [T] 

sep (P*,tt) < P(T > t) , for all t > 0. (2.1) 
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An optimal SST is one which achieves equality in (|2.ip for all t > 0: existence 
is demonstrated in [I] (in discrete-time). 

We may now define the notion of a cutoff phenomenon for a given distance 
function D (including, but not restricted to, those distances defined above). 

Definition 2.2. For n > 1, let X n be a stochastic process taking values on a 
finite space (E n , £ n ), with time-i distribution P n and stationary distribution 7r n . 
We say that the sequence {E n , X n , ir n ; n = 1, 2, . . . } exhibits a (r„, b n )-D-cutoff 
if r„, 6„ > satisfy 6„ = o(r n ) and 

gL(c) = liminf D(P^ n+cbn ,n n ) satisfies lim d_(c) = l, 

n— »oo c— >— oo 

d+(c) = limsupZ?(P,[" +cb ",7r„) satisfies lim c2+(c) = 0. 

n — ^oo c— >oo 

Here t„ is called the cutoff time, and & n will be referred to as the window 
of the cutoff. (We may simply say that the sequence X n exhibits a r n -D-cutoff 
when we are not concerned with the window size b n .) 

Furthermore, it is possible to analyse the window size in more detail by 
considering separately the windows either side of the cutoff time r„. That is, 
instead of using a single sequence b n to establish convergence in equations (I4.2p 
and (14.31) . we can consider each convergence statement separately. 

Definition 2.3. Suppose the sequence {E n , X n ,Tr n } exhibits a r„-_D-cutoff. If 
there exist sequences b^, b^ with max{6^, b^} — o(r„), such that 

d^_{c) = liminf D(Pn" +cb ™ , n n ) satisfies lim rf^(c) = 1, 

n— ► oo c— > — oo 

and d^(c) = limsupD(P^" +c& " ,ir n ) satisfies lim d+(c) = 0, 

71— >00 C— >0O 

then b^ will be called a left-window and b^ a right-window of the cutoff. 

To the best of the author's knowledge, the only published article to identify 
a difference between the left and right windows of a cutoff phenomenon is [3]. 
For the processes considered in this paper however, such a distinction will prove 
to be rather important. 



3 Separation cutoff for n-tuples of independent 
processes 

Let X n — (X^, X%, ■ ■ ■ , X™) be an n-tuple of independent, continuous-time 
Markov chains on a finite space (E n ,£ n ), with initial state x n = (x n , . . . ,x™) 
and stationary distribution ir n — ir n x . . . x 7r™ . Let 

sep„(i) =sep(P^,7r„) and sep^ (t) = sep [P ni , <) , 

where P n i denotes the distribution of X n at time t. 
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Proposition 3.1. For all t > 0, 

n 

sep„ (i) = 1 - - sepj, (t)) . 
i=i 

Proof. The independence of the chains implies that 

- P* -IV v i ) ™ 

l-SePn(*)= , mm II it is =ll( 1 - sc Pn(0) ; 

since each term in the product may be minimised individually. □ 

If T n is an optimal SST for X n (1 < i < n), then letting T n = maxT^ one 
can check that T„ is a SST for the n-tuple. Proposition 13.11 shows that 

sep„ (t) = P(T n > t) for all t > 0, 

and it follows that T n is an optimal SST for X n . 

As in [2], we are interested in processes for which each component X l n con- 
verges at an exponential rate \ l n , although now this convergence is to be mea- 
sured using separation distance. Rather than following the route of [2] and 
using an ordered set of rates {A( i n )}, we prefer to work instead with discrete 
probability measures /i n on (0, oo), where 

Mn({A}) = \ #{K : A; = A} . 

(This is similar to the use of design measures in design theory, see e.g. |15j.) 
The result of this will be that the existence of a separation cutoff can be directly 
related to the convergence of appropriately scaled versions of jj, n as n — > oo. We 
define K n by 

K n = min {A > : /i„(0, A] > 0} . 
The main result of this paper is the following: 

Theorem 3.2. Let X n be an n-tuple of independent ergodic Markov processes, 
each of whose components satisfies \g\i (t)\ < g(t) for all t > 0, where g\i is 
defined by 

and where g is a bounded continuous function satisfying g(t) < 0(t _1 ). As 
above, let fx n be the discrete probability measure describing the set {A^}, with 
support [k„, oo). 

1. The sequence of n-tuples X n exhibits a separation cutoff at time 

flog(n/x n (0,A])\ 

T n = max <^ } 

a>k„ I A J 

if and only if T n K n — > oo; 
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2. The window of the separation cutoff is in general asymmetric: the left side 
is at most 0(1/ K n ), and the right side is bounded above by W(r n /t n ) / n n , 
where W is the Lambert W -function. 



As remarked in [2] , under the conditions of Theorem 13.21 the spectral gap 
of X n is equal to K n and the separation-mixing time equivalent to r n . Thus 
Theorem l3.2f i) shows that the conjecture of Peres (reported in (8J [4]) holds true 
for separation cutoff for the processes considered here. 



Consider an n-tuple X n satisfying the conditions of Theorem 13.21 Using fi r , 
and Proposition 13. 11 the separation distance at time t may be written as 



sep„ (i) = 1 — cxp J log(l 



e -*(A- 9 ,(t)) K(dA) ) _ (3 _ 1} 



One benefit of working with separation distance in this setting is that equa- 
tion (I3.1[) holds for any fi n , whereas there is no longer a simple exact expression 
for the total-variation distance between and 7r„ when the rates X l n are not 
identical [2J. 

The proof of Theorem l3.2l will be established by the results of Proposition^ 
Lemmal3.6land Theorem 13.71 below . 



Proposition 3.3. For the sequence {X n } to exhibit a r n - separation cutoff, it 
is necessary for T n K n — > oo. 

Proof. Restricting attention to the mass at K n in equation (|3.ip immediately 
implies that, for any c > 1, 

sep„ (cr„) > exp(-cr„(K n - g Kn (cT n ))) 

> exp(-cr„K„)exp(-cr„g(cr„)) . 

For a separation cutoff to hold at r n , we require that sep„ (cr„) —¥ for all fixed 
c > 1: this fails, however, if t„k„ oo (since the final exponential term above 
is bounded away from zero due to our conditions on g). □ 

Now, given a measure /i n , define r„ by 

f log(n/x n (0,A])) log(n/z n (0,A;]) 
T n = max <^ } = — , (3.2) 



a>k„ 1 A 

where A* G [k„,oo) is defined by this last equality. (If there are two or more 
values of A achieving the maximum in equation (|3.2[) then we shall (arbitrarily) 
always take A* to be the minimum of these values.) Given A* , we may define a 
new measure v n on (0, oo) as follows: 

* })= w (3 - 3) 

This measure has total mass (/i n (0, A*]) -1 € [1, n] and satisfies f n (0, 1] = 1. The 
idea behind this scaling is as follows: A* describes in some sense the 'critical 
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point' of [i n - it will be shown that if t„k„ — > oo then any mass \x n places to 
the left of A* will not influence the separation cutoff time. For ease of notation 
we define 

0n = nfi n (0, A*] € [l,n] . 

Lemma 3.4. If T n n n — ► oo fftera: 

(%) /3„ ->• oo; 

(ii) v n (Q,l] — > ^! (where denotes weak convergence). 
Proof. (i) /3 n = exp(r„A* ) > exp(r„K„) — ► oo by assumption, 
(ii) By definition of r„ (|3.2|) . 

log(n M (Q,A]) logA, forallA > Kn 

A A; 

Thus for all a; > « n /A*, 

]o S (n A i m (0,xA;]) £ 

a; 

This yields 

nMn(0, a;A;] < ^ for all z > n n /K- ( 3 - 4 ) 

Hence 

^(0,x] = = < ^ , (3.5) 

where the inequality follows from (|3.4j) . Thus for all e g (0, 1), 
v„(0,l-e] </?~ £ ►(). 

n— foo 

Since ^ n (0, 1] = 1 for all n, this proves the required convergence. 

□ 

This makes more precise what is meant by A* describing the 'critical point' 
of /i n . Under the assumption that T n K n — > oo, the measures v n converge weakly 
to Si on (0, 1]: this is exactly the sort of behaviour to be expected if the sequence 
{A*} captures information about the cutoff time. Lemma T3. 61 and Theorem 13. 71 
make this observation exact: their proofs rely on Proposition 13. 5[ which de- 
scribes the behaviour of the function 9 n defined by 



t (t) = /3n exp{-t\* n \)v n (d\) . (3.6) 



Proposition 3.5. The following inequalities hold for all t > log2//t n : 

1 - eM-e- t9{t) 0n{t)) < sep„ (t) < 1 - exp(-2e 2t ^ n (t)) . (3.7) 
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Note that if t„k„ — > oo, Proposition [33] implies that the behaviour of sep( n ) 
around r„ is determined by that of n . 

Proof. Using the measure v n , the separation in equation (13. ip may be rewritten 
as follows: 

sep„ (i) = 1 - exp jf ^ log (l - e -W-^«)) ^„(dA)^J . (3.8) 

Now note that the following simple inequality holds for < x < 1/2: 

—x — x 2 < log(l — x) < —x . 

Applying this inequality to the log term in equation (|3.8p . and bounding g\^\(t) 
by ±g(t), shows that for all t > log2/ft„ : 

1 - exp(-e-*9( t )^(t)) < sep„ (t) < 1 - exp(- e **M0 n (i) - e 2t ^0 n (2i)) . 

Finally, observe from (|3.6I) that n (2t) < 6 n (t) for all £ > 0: the result follows 
immediately. □ 

We are now in a position to prove the existence of the left-hand side of the 
cutoff in Theorem [ 



Lemma 3.6. Suppose that t„k„ — > oo, with r n defined as in S3.2\) . Let 
1/A* < 0(1/ K n ). Then 



sep^(c) = liminf sep n ir n + cb„) satisfies lim sep^(c) = 1. 

c— > — oo 



(Note that since t„k„ — > oo, — o(r„), as is required for any candidate 
window-size.) 

Proof. Consider 9 n (r n + c/A* ), for fixed c € K. Since r n K n — > oo it follows from 
Lemma I3.4f i) that for any fixed eel, 

c log/3 n + c 
T n + -z— = ; > 

for large enough n. By definition of r„, with r„ + c/A* > 0: 

/•OO 

6>„ (r„ + c/A r *J = 0„ / exp(- [r„ + c/A r * ] A r * A)i/„ (dA) 

JKn/K 

> p n I exp(- [r n + c/A*] A*A)z/ n (dA) 



>A,i/ n (0,l] ( — ) =e- c . (3.9) 
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Combining Proposition 13.51 and inequality p.9[) shows that for all c <E 
sep^(c) > 1 — limsup exp(— e -7 ™ ^0 n (T n + c/A*)) , 

n— >oo 

where 



7n(c) = (T n + c6^)<?(r„ + c6^) ~ r nff (r n ) = 0(1) . (3.10) 



Hence 



sep_(c) > 1 - exp(-Me~ c ) , 

for some finite constant M > 0, and thus sep^(c) — >• 1 as c — > — oo, as claimed. 

□ 

It turns out that the general bound for the right-window of the cutoff is 
significantly larger than that for the left. Theorem 13. 7\ which completes the 
proof of Theorem 13. 2[ makes use of the Lambert W- function (see [7]). This is 
the function defined for all x e C by 

W{x)e w{x) =x. 

W(x) is positive and increasing for x € K+, with W(x) ~ log(x/logx) asi-> 
oo. 

Theorem 3.7. Suppose that T n K n — > oo, with r n defined as in LS.2\) . Then 
sep+(c) = limsup sep ra (r„ + cW (T n K n ) / K n ) satisfies lim sep+(c) = 0. 

n— too c—t-oo 

Proof. In order for a sequence b^ to be a right-window for the separation cutoff, 
it is sufficient to show that # n (r rl + c6„) < h(c) for sufficiently large n, where 
h(c) — > as c — > oo . For then, using inequality (13.7[) it follows that 

sep+(c) = limsup sep„ (r„ + cb^f) 

n— >oo 

< 1 - liminf exp(-2e 27 » (c) <9„(r„ + c6?)) , 

n— >oo 

where 7^(c) is defined analogously to p.!0|) . Thus, for some finite M, 
sep^(c) < 1 - exp(-Mh(c)) > . 

c— >oo 

We therefore search for an upper bound on the function d n ijn + cb^) for 
fixed c > 0. The form of r„, and use of integration by parts, yield the following: 

e n {Tn + Cbl) =f3 n — V n {d\) 



At 



K„/A* \ A 

A 

v n (0,X] 



' e -<*«K\ X 



K„/A* 

„c6? 'A* * ' ' e 



+ AJog(/3 n e c6 " A ") / — i/ n (0,A]dA. (3.11) 



K„/A* 



A* 
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Now, for c > 0, this first term is negative for all n. Discarding this, and using 
inequality (|3.5[) to bound v n (0, A] in the second term, we see that 



>(r n + ch*) < fi n log(/3„ e cb " A -) / ( 1—^1 ] pt 1 dX 

<„/A* V Pn I 



log(/3„e cb " A ") 



cb R X* 



= e - cb * K " + lj , by definition of r„. (3.12) 

Since 6^ must satisfy — o(r n ), this upper bound tends to infinity with n 
unless cb^K n > W(T n K n ), by definition of the Lambert PF-function. Thus, with 
bn = W(T n n n )/n n , (|3~12l) satisfies 




It follows that for c > 1, # n (r n + cW(T n K n )/ n n ) — > as n — > oo, and so 
sep+(c) = limsup sep n (t„ + cVK(t„k„)/k„) = . 

n— >oo 

Therefore b^ = W(T n K n )/ n n is a right- window of the cutoff, as claimed. □ 

This bound on the right-window is significantly larger than that for the left- 
window. Since T n K n necessarily tends to infinity when a separation cutoff holds, 
it follows that 

0(1/K n ) < = o(r„) . 



3.1 Random walks on Z£ 

Let Z£ be the group of binary n-tuples under coordinate-wise addition modulo 2: 
this can be viewed as the vertices of an n-dimensional hypercube. A continuous- 
time random walk X n on Z£ may be defined as follows. Let {A^ : 1 < i < n} 
be a set of independent Poisson processes, with the rate of A^ equal to 2p l n : 
whenever there is an incident on A^, with probability 1/2 the i th coordinate, 
X nt i, is flipped to its opposite value. The unique equilibrium distribution of X n 
is the uniform distribution on Z£ , U n - 

Let be the time of the first incident on A^. It is simple to show that T£ 
is an optimal SST for X n ^, with 

p(t; >t) = e - 2tp - . 

Thus T n = maxT^ is an optimal SST for X n . (This is similar in flavour to the 
optimal SST for the continuous-time birth-death processes of [5]: there the SST 
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is given by a sum of exponential random variables of varying rates, rather than 
their maximum.) 

It follows that X n satisfies the conditions of Theorem 13.21 with 

Kl = 2 Pn > and .9 = • 

Writing p* n — min {p l n }, the sequence X n therefore exhibits a separation cutoff 
at time 

f log(n// n (0,2p] )" 
t„ = max <^ 

if and only if r n p* — > oo. In this case, t„ = 2f„, where f„ is the total-variation 
cutoff time according to Theorem 12 of [2]. 

For many simple examples, such as the symmetric random walk for which 
all coordinates jump at rate 1, the result of Theorem 13.71 gives an extremely 
conservative bound for the right-window. (Simple direct calculations show that a 
(logn/2, l)-separation cutoff holds, whereas the bound on 6^- from Theorem 13. 71 
tends to infinity with n.) However, the following example shows that the bound 
of Theorem 13 . 71 can be achieved, and so cannot be improved upon in general. 

Example 3.8. Consider the sequence of random walks on with p l n — 
max{l, 21og„(i)}. The associated probability measure for X n is 



1 

Mn = ~ ^max{2, 41og„ (i)} ■ 
i=l 

The measure p, n places all its mass in the interval [2,4], with n n — 2 and 

I n A / 4 I 

Pn% A] = L J ~ n A /* -1 , for all A e [2,4]. 
For this sequence, 

f log(^»[2,A]) ) f log(n A / 4 ) ) logn 
r„ = max <^ \ = max <^ } = —— . 

2<A<4 L A J 2<A<4 i A J 4 

Note that this maximum is attained at all A € [2,4]: we arbitrarily take A* = 2 
to be the minimum of these values. This gives /3„ = ^/n, and hence ^ n [l,a;] = 
n (x-i)/2 f or x g j-^^ 2]. Since r„ — > oo as n —> oo, this random walk exhibits a r„- 
separation cutoff. Now, by Lemma \TM the left-window of this separation cutoff 
is bounded above by 1/A* = 1/2. However, for fixed c > and some sequence 
bn = °( T n), integration by parts as in equation (|3 . 11 1) yields the following: 
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Arguing as in the proof of Theorem 13.71 a (t„, ^-separation cutoff does not 
hold for any sequence 6^ = o(W(T n )) (see [5] for further details). 



3.2 Links to extreme value theory 

Looking back to the discussion following Proposition 13. 1[ where the separation 
distance is identified as the tail distribution of the maximum of a set of indepen- 
dent random variables it is reasonable to ask how the above results relate 
to the theory of extreme values. If the random variables {T^} are i.i.d. for 
all i and n then the Fisher-Tippct-Gnedcnko Theorem guarantees convergence 
in distribution of a renormalized T n to one of three possible distributions. For 
example, if X n is a random walk on for which the rate of each coordinate is 
chosen at random, with 



nPn=Pk) = q k 



k = 1, . . . , m, 



for all i and n, Theorem 2.7.2 of [10] shows that a renormalized T n has a limiting 
Gumbcl distribution. Indeed, writing p* = minjpfe}, direct calculation shows 
that 



sep. 




> 1 - exp(-<7*e c ) . 



In this case we see that both right- and left-hand windows are O(l). 

More generally, the function 8 n defined in equation (|3.6I) may be interpreted 
as follows. Let {V£ : 1 < i < n} be independent, identically distributed random 
variables, whose distribution is a mixture over A of Exp(X) distributions, with 
mixture probability distribution \x n . Then, for t > 0, 



and so 



E 



.4=1 



\v: > t) 



L K>t] 



-XI 



nn(d\) = e n (t). 



Thus 9 n (t) describes the mean number of exceedances of level t by the set of 
random variables {V^}. In particular, Proposition 13.51 implies that the set of 
n-tuples driven by [i n exhibits a r„-separation cutoff if and only if 



E 



.i=l 
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4 Coupling cutoffs 



It is well known that the coupling method can be used to bound the rate of 
convergence to equilibrium of a Markov chain, via the coupling inequality (see 
[T2"]). Let X n and Y n be two copies of a Markov process on E n with equilibrium 
distribution n n . 

Definition 4.1. A coupling of X n and Y n is a process (X n ,Y n ) on E n x E n 
such that 

X n = X n and Y n = Y n , 

T> 

where = denotes equality in distribution. 

The coupling time T£ of X n and Y n is defined by 

T„ c = inf{i>0 : X t n = Y*) . 

For a given coupling of X n and Y n , define 

F n (t)=F(TZ>t), f>0, (4.1) 

to be the tail probability of T°. Suppose now that X® = is fixed, and that 
Y® ~ 7rJJ. We then define the following behaviour, in analogy with Definition ^. 21 

Definition 4.2. For n > 1, let TJJ and F n be defined as above. We say that 
the sequence {E n , X n , n n , T£} exhibits a {T n ,b n )-coupling-cutoff if T n ,b n > 
satisfy b„ = o(r n ) and 

F_(c) = liminf F„(r„ + cb n ) satisfies lim F_(c) = l, (4.2) 

F + (c) = limsupf , „(r„ + c6 n ) satisfies lim F + (c) — 0. (4-3) 

Thus a coupling cutoff occurs when the distance between the two processes, 
measured using the tail probability of the coupling time asymptotically 
exhibits an abrupt change from one to zero at time r n . (Note that if T£ is a 
maximal coupling time for all n [TT] then a coupling-cutoff is equivalent to a 
total-variation cutoff.) As with the optimal SST of Section [3j if (X n ,Y n ) is 
a pair of n-tuples whose i th coordinates may be independently coupled at an 
exponential rate A^, then T° is the maximum of n coupling times and this yields 
an analogous version of Theorem 13.21 for coupling cutoffs. 

For the random walks on considered in Section [3. 11 no intuitive maximal 
coupling is known in general; for the symmetric random walk a (nearly) maximal 
solution is presented in [13] . and a stochastically optimal co-adapted coupling is 
described in [6]. However, X n and Y n may be simply coupled by allowing their 
i th coordinates to evolve independently until the time that they first agree, 
whereafter they move synchronously. If A° and Y® do not agree on the i th 
coordinate (which happens with probability 1/2), then it follows that the time 
taken for agreement on this coordinate is equal to the time of the first incident on 
a Poisson process of rate 2p l n , and so this coupling takes place at an exponential 
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rate. Thus a random walk on Z£ exhibits a coupling cutoff if and only if it 
exhibits a separation cutoff (with the same values of r„ and b n ). 

In general, the assumption that each component of the n-tuples may be co- 
adaptedly coupled at an exponential rate is not restrictive: indeed, this is a 
reasonable assumption for many Markov processes of interest [3]. There is also 
a possibility that the coupling variant of Theorem [JO] outlined above could have 
interesting consequences for coupling-based perfect simulation algorithms (such 
as CFTP and variants) for high-dimensional distributions. 
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